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related to a primary source of information. Channel changing on a television can be presented as a rotation of the multifaceted 
object. In like manner, other familiar representations, such as a representation of a book can be used, wherein channel changing is 
presented as a turning of the pages of the book, each television program being presented on a different page. Advanced features, 
such as program categorization, can be represented as tabs on the book that facilitate the selection of a particular category. In like 
manner, a rotation of a multifaceted object about one axis may correspond to a change of channel within a select category, whereas a 
rotation about another axis may correspond to a change of category. Techniques are presented for achieving these three dimensional 
effects with calculations that are well suited for execution via the sample rate converters of conventional display systems. 
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Video Sample Rate Conversion to Achieve 3-D Effects 



This application claims the benefit of U.S. Provisional Application No. 60/175,189, filed 10 
January 2000. 

BACKGROUND OF THE INVENTION 

5 1 . Field of the Invention 

This invention relates to the field of video signal processing, and in particular 

to the creation of 3-D effects via video sample rate conversion. 

2. Description of Related Art 

1 0 High quality video display systems, such as high definition television (HDTV) 

systems, are becoming increasingly popular, and therefore increasingly cost and feature 
competitive. To remain competitive, a system must offer more functionality, or be more 
attractive to a purchaser, or have other features that distinguish the system from other 
systems. Preferably, these features are provided at substantially the same cost as systems 

1 5 without these features, so that the combination of features and price facilitate an increase in 

market share, or profits, or both. 

One such distinguishing feature among systems is, for example, a "picture-in- 
picture" (PIP) capability, wherein a second video image can be superimposed upon a primary 
video image. When initially offered, PIP capable televisions commanded a higher selling 

20 price. Competing systems thereafter offered additional PIP features, such as user-controllable 
sizing and positioning of the PIP image on the display. Following computer interface 
paradigms, television systems are currently available that offer "windowing" features, 
wherein different video images can be displayed in different windows on the television 
display. The video images can be other television program images, a channel selection guide, 

25 or communications related to a primary image, such as a window that contains ancillary 

information about the program being viewed, a detailed view of an item that is advertised for 
sale, and so on. Televisions that provide these capabilities often provide a higher profit 
margin than less capable televisions, particularly when the capability is new, because often 
the additional cost to add the feature is low, but the demand for the feature is high. 
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In like manner, providers of Internet-based television can be expected to 
compete for viewers, in order to allow them to command higher advertising prices. If a 
particular television display system provides a desirable feature, the providers of the Internet 
service will provide programs that are capable of using the feature, thereby increasing the 
5 demand for that provider's service, as well as an increased demand for display systems that 
include the feature. 

To achieve the aforementioned PIP and windowing video effects, each video 
image must be scaled to fit the allocated display area for the image. In a digital display 
system, sample rate converters (SRCs) are used to effect the scaling. A digitally encoded 

10 video image comprises an array of samples of the original image; a display screen area 

comprises an array of pixels. If the number of samples in the horizontal and vertical direction 
are equal to the number of pixels in the horizontal and vertical direction, no scaling is 
necessary. Each sample is mapped to each corresponding pixel, and the resultant displayed 
image corresponds to the original image. If there are half the number of pixels as there are 

1 5 samples, every other sample is mapped to a corresponding pixel. The resultant image 

corresponds to an image that is sampled at half the sampling rate of the original samples. 
That is, a change of scale is equivalent to a change of sampling rate, hence the term 'sample 
rate converter'. Non-integer scaling is effected by generating pixel values corresponding to an 
estimate of the sample value that would have been obtained had the original sampling rate 

20 corresponded to this display scale. These generated pixel values are typically obtained by 

interpolating the value from a set of samples about each pixel location. Conventional display 
systems include both a vertical sample rate converter and a horizontal sample rate converter 
to effect the scaling in either or both dimensions. 

Computer graphic systems are available that can produce visual effects on a 

25 display screen that convey a concept of depth perception, or three dimensional imaging. 
These graphic systems use complex graphic accelerator devices to achieve this three 
dimensional effect. The graphics accelerator devices, however, are not directly compatible 
with conventional video rendering systems, and are not yet able to meet the quality demands 
of conventional video display systems. The cost of a graphics accelerator device that can be 

30 used to produce three-dimensional effects in a video display system can be expected to 
substantially increase the cost of the display system. 
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BRIEF SUMMARY OF THE INVENTION 

It is an object of this invention to provide additional features for video display 
systems. It is a further object of this invention to provide a video display system with three- 
dimensional effects. It is a further object of this invention to provide three-dimensional 
5 effects on a video display system without substantially increasing the cost of the system. 

These objects and others are achieved by using the two dimensional sample 
rate conversion capabilities of a video display system to produce three-dimensional effects. 
Linear and non-linear scaling is applied to a video image to convey a sense of depth. The 
three dimensional effects are used to increase the visual appeal of existing and new feature 

1 0 sets in display systems. A multi-faceted object representation, such as a representation of a 
cube or a pyramid, can be used to display different video images on each facet of the 
representation. By appropriately scaling each image on each facet, an impression of depth is 
achieved. The images on the different facets can be selected to represent different aspects of a 
common theme, such as datacast information related to a primary source of information. 

15 Channel changing on a television can be presented as a rotation of the multifaceted object. In 
like manner, other familiar representations, such as a representation of a book can be used, 
wherein channel changing is presented as a turning of the pages of the book, each television 
program being presented on a different page. Advanced features, such as program 
categorization, can be represented as tabs on the book that facilitate the selection of a 

20 particular category. In like manner, a rotation of a multifaceted object about one axis may 
correspond to a change of channel within a select category, whereas a rotation about another 
axis may correspond to a change of category. Techniques are presented for achieving these 
three dimensional effects with calculations that are well suited for execution via the sample 
rate converters of conventional display systems. 

25 

BRIEF DESCRIPTION OF THE DRAWINGS 

The invention is explained in further detail, and by way of example, with 
reference to the accompanying drawings wherein: 

FIG. 1 illustrates an example block diagram of a 3-D scaler in accordance with this invention. 
30 FIG. 2 illustrates an example block diagram of a video display system in accordance with this 
invention. 

FIG. 3 illustrates an example flow diagram of a 3-D scaler in accordance with this invention. 
FIGs. 4A-4E, and 5A-5C illustrate example perspective renderings in accordance with this 
invention. 
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FIGs. 6A-6B, 7, and 8A-8B illustrate example 3-D object renderings in accordance with this 
invention. 

Throughout the drawings, the same reference numerals indicate similar or 
corresponding features or functions. 

5 

DETAILED DESCRIPTION OF THE INVENTION 

This invention enhances the presentation of video images by adding three- 
dimensional (3-D) effects to the rendering of the image. As contrast to graphic processors 
that render 3-D object images onto a 2-D plane, this invention adds a third dimension to a 

10 conventional 2-D video image. That is, an object in a graphics system includes length, width, 
and depth information, as well as three-dimensional coordinates in an object space that 
defines where each object is located. The graphics system performs the necessary operations 
to discern a projection of 3-D objects onto the 2-D image plane of a display, including 
determinations as to the size and shape of each object's projection, relative to an assumed 

1 5 viewer, determinations as to which objects block the view of other objects, and so on. In this 
invention, the source of information is a two-dimensional image. A third dimension is added 
to the two-dimensional video image by treating the image as an image plane, and emulating a 
rotation, or other change of orientation, of the image plane relative to the plane of the display 
screen. A region of the image plane that is conceptually farther from the viewer because of 

20 this rotation is rendered at a smaller scale than a region that is conceptually closer to the 
viewer, thereby conveying a sense of 'depth* to the rotated image. As discussed below, this 
emulation of depth is effected via a modification to the control and operation of the 
horizontal and vertical sample rate converters of conventional high quality video systems. 

FIG. 1 illustrates an example block diagram of a 3-D scaler 100 in accordance 

25 with this invention. As illustrated, the 3-D scaler 100 comprises a control unit 1 10, a vertical 
sample rate converter 120 and a horizontal sample rate converter 130. Note that the paradigm 
of scaling via sample rate converters is used herein for ease of understanding, because sample 
rate converters are commonly used to effect scaling, as discussed above. It will be evident to 
one of ordinary skill in the art in view of this disclosure that any other scaling means can be 

30 employed to effect the same visual results, and are included in the intended scope of this 
invention. 

The sample rate converters 120 and 130 operate similarly to conventional 
sample rate converters that are used to scale video images in the vertical and horizontal 
direction, except as detailed below. The control unit 1 1 0 controls the flow of data through the 
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converters 120, 130, via the switches 1 15a-c. The control unit 1 10 also provides vertical and 
horizontal scaling factors, VS and HS, to control the degree of scaling provided by the 
vertical 120 and horizontal 130 sample rate converters. The operation of the scaler 100 is best 
understood with reference to the example flow diagram of FIG. 3, and the resultant effects on 
5 the rendering of a video image, as illustrated in FIGs. 4A-4E, and 5A-5C. 

FIG. 3 illustrates an example flow diagram of a 3-D scaler, such as the scaler 
100 of FIG. 1, in accordance with this invention. Note that, for ease of reference, reference 
numerals that are between 100 and 199 refer to items in FIG. 1, whereas reference numerals 
between 300 and 399 refer to items in FIG. 3. At 310, an input video image 101 is associated 

1 0 with a rotation, or orientation 1 02, angle A. At 320, the flow branches in two, depending 

upon whether the rotation is relative to the vertical axis or the horizontal axis. This branching 
corresponds to the control of the switches 1 15a-c by the control unit 110 of FIG. 1 . The 
setting of the switches 1 15a-c that is illustrated in FIG. 1 corresponds to a rotation about the 
y, or vertical, axis, and corresponds to the left set of steps in FIG. 3 after the branch at 320. 

15 As is known in the art, a rotation of a plane about the y-axis can be represented 

by the following transformation: 

x' = x * cos(A) - z * sin(A) (1) 
y' = y • (2) 

z' = x * sin(A) + z * cos(A) (3) 

20 where x, y, and z are the coordinates within the plane before the rotation, and x', y', and z' are 
the resultant coordinates after the rotation about the y-axis through an angle A. In this 
coordinate system, z corresponds to a distance "away" from the viewer, such that a positive z 
coordinate is farther away from the user than a zero or negative coordinate. For ease of 
understanding, the initial z value assigned to the image is assumed to be zero, although one of 

25 ordinary skill in the art will recognize that if a non-zero z is used, the z*sin(A) term merely 
translates each x' coordinate by a fixed amount, and could be represented by a translation 
block after the horizontal scaling block 320. Note that the horizontal scaling of each x 
coordinate is by the same scaling factor, cos(A). In the example embodiment of FIG. 1, this 
scaling factor HS is provided by the control unit 1 10 to the horizontal sample rate converter 

30 130, and the converter 130 scales the input video image 101 by this factor HS. FIGs. 4A-4B 
illustrate a scaling of an image 410a by a scaling factor corresponding to a rotation about an 
angle aO to form a horizontally scaled image 410b. In FIG. 4B, the extent X0' of the scaled 
image 410b is equal to the extent X0 of the original image 410a multiplied by the cosine of 
the orientation angle aO relative to the plane of the original image 410a. Note that this 
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horizontal scaling as a function of the orientation angle aO achieves the foreshortening of an 
image that occurs when the image is viewed from an angle, but does not convey a sense of 
depth. 

To represent depth, a perspective rendering is provided in accordance with this 
5 invention. In a perspective rendering, objects that are farther from a viewer appear smaller 
than when they are closer to the viewer. In general, a perspective rendering is a linear 
transformation: 

si =s0 * dO/dl, (4) 
where sO represents an apparent size of an object at a distance dO, and si represents an 
10 apparent size of the same object at a distance dl . Often, the distance dO is referred to as the 
focal distance to the original image. In the context of this disclosure, the distance dO is equal 
to an assumed focal distance, f, of a viewer from the original image plane, and the distance 
dl is the resultant distance from the viewer caused by the introduction of a z-component by 
the emulated rotation of the image from the original image plane: dl = f + z\ Thus, equation 
15 4 can be rewritten as: 

x" - x' * f/(f+z'). (5) 
y " = y * f/(f+ z '). (6) 

As equations 5 and 6 indicate, both the x coordinates and the y coordinates 
should be scaled as a function of the distance z' that is introduced by the rotation of the 

20 image. That is, each image sample must be scaled in both the x and y dimensions as a 
function of the z coordinate, or depth, of each sample in the rotated image. 

In accordance with one aspect of this invention, to reduce processing time, it 
has been determined that a scaling in the axis that is opposite to the axis that is foreshortened 
by the rotation of the image plane is sufficient to convey a sense of depth. For example, in 

25 FIG. 4B, the farthest extent X0' of the rotated image 4 1 Ob is farther away from the viewer by 
a distance of Z0\ To produce an effect corresponding to a perception of depth, in accordance 
with this aspect of the invention, the vertical size Y0 of the farthest extent X0 of the image 
410b is scaled by a factor of f/(f+Z0') to produce a reduced vertical size Y0 r as illustrated in 
FIG. 4C. Each y coordinate is similarly scaled, producing the sloped upper and lower edges 

30 of the image 410c. Note that although the x coordinates of FIG. 4C are unchanged from the 
foreshortened view FIG. 4B, a sense of depth is created by the scaling of the y coordinates as 
a function of the distance z. Also note that in FIG. 4C, the closest extent XI' of the rotated 
image is closer to the viewer than the original image plane, and thus the vertical size YT 
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corresponding to a scaling by f/(f+Zl') is larger than the original vertical size at this nearer 
extent, because the sign of Zl is negative in the convention used herein. 

With regard to FIG. 1, this scaling of the y-coordinates as a function of 
distance from the viewer is effected by routing the output of the horizontal sample rate 
5 converter 130 to the vertical sample rate converter 120, via switch 115c, and scaling by a 
vertical scaling factor VS that varies as a function of the determined depth parameter, z, of 
each coordinate of the rotated figure. Note that in a rotation about the y-axis, the z coordinate 
value is constant for each column of constant x coordinate values. The control unit 1 10 
provides a vertical scale VS(x) to the vertical sample rate converter 120 for each column 

10 (discrete x value) of the rotated figure, corresponding to equation 6 above. As illustrated in 
the loop 340-370 of FIG. 3, the vertical sample rate converter 120 applies this scale value 
VS(x) for each horizontally scaled image value in a column, then applies the next scale value 
VS(x+l) to the next column of the horizontally scaled image values, and so on, until all of 
the vertical coordinates of the horizontally scaled image are scaled based on the perception 

15 depth factor f/(f+z). After the horizontal and vertical scaling, the pixel values resulting from 
this emulation of a three dimensional rotation of the original image are presented for display, 
at 380. As would be evident to one of ordinary skill in the art, optimization techniques can be 
applied in this process. For example, to reduce the number of divisions required to compute 
the perception factor (f/(f+z)) the scale of the closest and the farthest columns can be 

20 determined, and the scale factor of the intermediate columns can be determined by 
interpolation. 

FIGs. 4D and 4E illustrate a rotation of the image 410a through a larger angle 
al. As discussed above, FIG. 4D corresponds to a horizontal scaling of the image 410a by a 
constant scale factor corresponding to cos(al), and FIG. 4E corresponds to a vertical scaling 
25 of the horizontally scaled image 410d by a scale factor that varies as a function of the 

distance from the original image plane, corresponding to f/(f+z). As illustrated, a progression 
from FIG. 4A to FIG. 4C to FIG. 4E will convey a sense of rotation of the image through a 

three dimensional space. 

FIGs. 5A-5C illustrate an example rotation of an image 510a through the x- 
30 axis, and corresponds to the flow illustrated on the right hand side of FIG. 3 after 320. As is 
known in the art, a rotation about the x-axis results in the following transformation of 
coordinates: 

x' = x (7) 
y' = y * cos(A) + z * sin(A) (8) 
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z' = -y * sin(A) + z * cos(A) (9) 
where z has the sense (sign) corresponding to a distance away from a viewer, discussed 
above. As illustrated, the image 510a is initially scaled in the vertical dimension by a 
constant scale factor that corresponds to cos(bO) to produce the shortened image 510b of FIG. 
5 5B, corresponding to block 335 of FIG. 3. 

As discussed above, the opposite axis from the one that is initially scaled by 
the constant scale value is subsequently scaled by a scale factor that varies as a function of 
the z-coordinate, or depth introduced by the rotation, corresponding to equation 5, above. 
That is, each row of the rotated image values of the image 5 10b is scaled by a different 
10 horizontal scaling factor, to produce the sloped horizontal edges of the image 510c in FIG. 
5C. These sloped edges produce the desired visual effect of a rotation of the image 510a 

about the horizontal axis. 

The control unit 1 10 of FIG. 1 effects the above process by switching the 
switches 1 15a-c to the opposite state of the state illustrated in FIG. 1 . Thereby, the video 

15 image 101 is routed, via 1 15a, to the vertical sample rate converter 120, and is scaled by the 
vertical sample rate converter 120 using a constant vertical scale factor VS from the control 
unit 1 10. Thereafter, the vertically scaled image is routed, via 1 15b, to the horizontal sample 
rate converter 130. The horizontal sample rate converter 130 scales each horizontal row of 
the scaled image using a horizontal scale factor HS that is determined by the control unit 110 

20 for each row, based on the z-dimension of each row, and based on a given focal distance, f. 

It is significant to note that, in accordance with this invention, the control unit 
can effect a variety of perspective renderings, via a control of the horizontal and vertical 
scaling parameters HS and VS that are provided to horizontal and vertical sample rate 
converters that substantially correspond to sample rate converters currently used in high 

25 quality video systems. In this manner, the 3-D effects discussed above, and others, can be 

achieved with a minimal additional cost. Note also that the constant-scaling in one dimension 
aspect of this invention is provided to reduce the required processing, while still conveying a 
perspective effect. As processing power continues to increase, the control unit 1 1 0 can be 
easily reconfigured to effect a varying scale in both sample rate converters 120, 130, 

30 regardless of the axis of rotation, to implement both equations 5 and 6 for each processed 
image. Note also that the particular order of processing the image (horizontal scale then 
vertical scale for a rotation about the y-axis, and a vertical scale then horizontal scale for a 
rotation about the x-axis) is presented for ease of understanding, and for efficient processing. 
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Because the scaling in each dimension is independent of the other, the scaling by each sample 
rate converter 120, 130 can be effected in either order. 

The scaling that is effected to produce a 3-D effect can be combined with other 
techniques as well. For example, the horizontal and vertical sample rate converters 120, 130 
5 are conventionally provided in order to scale a video image to an allocated display area. In a 
preferred embodiment, the scale factors used to scale the image to the desired size are 
combined with the 3-D scaling factors. That is, if a factor Kl is the horizontal scale factor 
required to scale the original image to the pixels of the display area, the scaling factor that is 
used in equation 1 is Kl*cos(A), and in equation 5, the scaling factor is Kl*f/(f+z). 
10 The principles of this invention can also be applied to effect a rotation about 

the z-axis, which is, in effect a 2-D operation. As is known in the art, a rotation about the z- 
axis of an angle A results in the following transformation of coordinates: 

x' = x * cos(A) - y * sin(A), (10) 
y' = x * sin(A) + y * cos(A). (11) 
1 5 It can be shown that these equations can be transformed into a serial process. The first stage 
of this process is a vertical scaling: 

x' = x, (12) 
y' = x * sin(A) + y * cos(A). (13) 
The second stage of this process is a horizontal scaling of the vertically scaled coordinates: 
20 x" = x' * sec(A) - y* * tan(A), (14) 

y«=y\ (15) 

To effect a z-axis rotation, therefore, the control unit 110 routes, via 1 15a, the original image 
to the vertical sample rate converter 120, and provides a vertical scale factor corresponding to 
cos(A), then adds the x-dependent translation component (x*sin(A)) to each column of image 

25 coordinates. One of ordinary skill in the art will recognize this operation as a vertical 

shearing of the original image. This vertically sheared image is then routed, via 1 15b to the 
horizontal sample rate converter 130, with a horizontal scale factor corresponding to sec(A). 
Thereafter, a y-dependent translation component (y*tan(A)) is subtracted from the vertically 
sheared image. This horizontal scaling and translation corresponds to a horizontal shearing. 

30 The result of this dual shearing process corresponds to a 2-D rotation of the image. 

The equations 10 and 1 1 can also be transformed into a horizontal shearing 
followed by a vertical shearing. To avoid anomalous effects as the angle A approaches 90 
degrees, the control unit 1 10 is configured to effect a transposition to effect a 90 degree 



WO 01/52528 PCT/EPOO/12585 

10 

rotation, then rotates the transposed image by an angle of 90-A degrees, using the techniques 
presented above. 

Note that this sequential shearing process can be combined with the 
aforementioned conventional scaling to scale the image to an allocated display area, and can 
5 be combined with the aforementioned rotations about the x and y axes, thereby producing a 
helix-like visual effect, and other effects. As will be evident to one of ordinary skill in the art, 
other effects can also be realized via suitable mathematical transformations, such as an 
emulation of a sphere, or other complex shape, having one or more images presented as being 
rendered on the shape's surface. 

10 The emulation of 3-D effects on a video image can be used to provide a 

variety of visually enhanced features in a video display system. FIG. 2 illustrates an example 
block diagram of a video display system in accordance with this invention. As is common in 
the art, a high-quality video display system allows for the selection, via a selector 210, from 
multiple video image sources Va, Vb, Vc, etc., for simultaneous display on a display 250. For 

1 5 example, a common Picture-In-Picture television system allows the simultaneous display of 
images from two video image sources. A common multi-media computer system allows for 
the simultaneous display of images in discrete windows, limited only by the availability of 
inputs, the bandwidth of the sources, and the performance of the computer system. 

In accordance with this invention, the 3-D scaler 100 presented above is used 

20 to introduce 3-D effects on one or more of the selected images, typically in response to a user 
control 230. For example, in response to a channel-change command from a user, the selector 
210 and scaler 100 can be configured to "rotate" one channel's image away, while it rotates 
the next channel's image in. That is, the sequence of FIG. 4A, 4C, 4E could be used to have 
the first channel displayed as an image that is rotating substantially away from the user. 

25 When the rotation angle reaches 90 degrees, the selector can be configured to provide the 

second channel to the scaler 100, as the image plane continues to rotate toward 180 degrees. 
In this manner, the second channel image will appear to have been on the "reverse side" of 
the image plane containing the first channel image. Similarly, in a multi-channel system, the 
system can be configured to initiate the display of a next-channel while the current channel is 

30 being displayed; this subsequent display may be initiated upon the current image being 
rotated by a predefined angle. Similarly, the orientation angle of the next-image can be 
directly correlated to the angle of the current image, such as an angle of 90-A, thereby 
emulating images that are orthogonal to each other. Other effects can also be provided. For 
example, a channel-up command by the user can effect a rotation in one direction, while a 
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channel-down can effect a rotation in the opposite direction. In like manner, a jump to a 
specified channel can be emulated as a rotation about the opposite axis to the one used for 
incremental channel selection. The implementation of these and other 3-D visual effects will 
be evident to one of ordinary skill in the art in view of this disclosure. 
5 FIGs. 6A-B, 7, and 8A-B are example effects that can be realized by the 

principles of this invention. These examples are presented for illustration purposes, and are 
not intended to imply a limitation of the scope of this invention to these examples. These 
examples illustrate the use of a 3-D modeler 220 for configuring the orientations and 
relationships among a variety of rendered images to achieve a coherent visual effect. 

10 FIG. 6A illustrates what appears to be two sides of a three dimensional block. 

A first image 610 is rendered so as to appear on a surface of the three dimensional block that 
is coincident with the image plane, and a second image 620 is rendered so as to appear to be 
on a surface of the three dimensional block that is oblique to the image plane. This 
representation could provide an alternative to a "windowed" picture-in-picture display, 

15 wherein the oblique image is the secondary image. This representation could be a multi- 
image picture-in-picture image that appears within a larger primary image, and allows the 
user to simultaneously view two PIP images while viewing the primary image. The 
representation may also be a primary image 610 with ancillary, or "datacast", information 
620 related to the image, such as the credits, biographies of the performers in the primary 

20 image, and so on. In the e-commerce arena, the alternate image 620 may be information 
regarding ordering a product that is being advertised in the image 610. The advantageous 
uses of multiple image presentations are common in the art; this invention provides a means 
of providing such multiple image presentations in a more visually interesting form than static 
two-dimensional presentations. 

25 FIG. 6B illustrates a rotation of the representation of the three dimensional 

block. Note that in this example, the rotation is about an axis 650 that has a z-component that 
does not correspond to the plane of the original image 610, and thus the rotation introduces 
both a horizontal scaling as well as a horizontal displacement of the image, thereby further 
increasing the perception of depth. That is, the images 6 1 0 and 620 travel to the left as the 

30 block is rotated about the indicated direction about the axis 650, while at the same time, the 
image 610 continues to shrink as its angle to the viewing plane increase, and the image 620 
continues to expand. Note that a variety of user interfaces may be employed to effect this 
rotation. As in the prior example, a channel-up or channel-down command can effect a 
rotation of the block to bring the secondary image 620 into a primary viewing plane, 
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replacing image 610 in the final orientation of FIG. 6 A, such that an image from another 
source is brought into view at the location of image 620 in FIG. 6A. Alternatively, a pointing 
device may be available, such that when the user points to and selects the image 620 in FIG. 
6 A, the video system 200 effects the rotation illustrated in FIG. 6B. That is, the impression 
5 could be that a three dimensional object moves in response to a channel selection, or that a 
channel selection is achieved in response to an interaction with the three dimensional object, 
as illustrated by the bi-direction "orientation" arrow 215 of FIG. 2 between the selector 210 
and the 3-D scaler 100. These and other user interfaces will be evident to one of ordinary 
skill in the art in view of this disclosure. 

10 FIG. 7 illustrates a representation of a three-dimensional block wherein three 

surfaces are within view, and images 710, 720, 730 appear to be projected upon these 
surfaces. As above, the three images could be three different television programs, three 
different scenes from a DVD player, a primary image and supplemental images that relate to 
the primary image, and so on. This example illustrates a varying vertical scaling of image 

15 720, and a varying horizontal scaling of image 730. The user control 230 controls the selector 
2 1 0 and scaler 1 00 to facilitate a rotation of the representation of the three-dimensional block 
about either a vertical axis 750 or a horizontal axis 760. The alternative axis could correspond 
to different selection mechanisms. For example, advanced user interfaces for televisions 
include means for categorizing the choice of programs available at the time of viewing, such 

20 as "news", "sports", "comedy", and so on. In a preferred embodiment of this invention, a 
rotation about one axis corresponds to a selection within a category, such as a change of 
channel to the next news program, whereas a rotation about the other axis corresponds to a 

change of category. 

Although this invention has been presented with regard to simple three- 

25 dimensional objects, such as the blocks of FIGs. 6A, 6B, and 7, other representations can be 
employed to further increase the visual appeal of a video display system. The determination 
of the z-coordinate for a given representation of a three dimensional object can be extended 
beyond the equations 1-3 and 7-9 given above. One of ordinary skill in the art of computer 
graphics will be able to define other representations that are suitable for implementation in 

30 the control unit 1 1 0 of FIG. 1 for emulating a three dimensional transformation of an image 
plane. FIG. 8 A, for example, illustrates an image 810 that appears to be a page in a book 850. 
When a new image is selected for viewing, the video system 200 emulates a turning of the 
page to reveal a new image 820, as illustrated in FIG. 8B. Following the book analogy 
further, the book 850 is illustrated as having "tabs" 801, 802 that facilitate a selection from 
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different "sections" of the book, such as a "comedy" section, a "drama" section, and so on. 
When the user selects a given tab, or selects a given category, the video system 200 provides 
an emulation of a turning of multiple pages to display the first page (video image) at that tab, 
or within that category. 

5 The foregoing merely illustrates the principles of the invention. It will thus be 

appreciated that those skilled in the art will be able to devise various arrangements which, 
although not explicitly described or shown herein, embody the principles of the invention and 
are thus within the spirit and scope of the following claims. 
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CLAIMS: 



1 . A video display system (1 00) comprising: 

a horizontal scaler (130) that is configured to scale an input video image (101) 

in a horizontal direction, 

a vertical scaler (120) that is configured to scale the input video image (101) in 

5 a vertical direction, and 

a controller (110), operably coupled to the horizontal (130) and vertical (120) 
scalers, that is configured to effect a scaling of the input video image (101) via the horizontal 
(130) and vertical (120) scalers that corresponds to a perspective rendering (410c, 410e, 
510c, 620, 720, 730, 810) of the input video image (101), 

1 0 wherein 

the perspective rendering is achieved by applying a varying scale factor (HS, 
VS) to at least one of the horizontal (120) and vertical (130) scalers to render the input video 
image (101). 

1 5 2. The video display system (1 00) of claim 1 , further including 

a source of multiple input video images (2 1 0), and 
wherein 

the controller (110) is further configured to selectively render at least two 
input video images (610, 620) of the multiple input images to form a composite perspective 
20 rendering corresponding to a representation of a three dimensional object. 

3. The video display system (100) of claim 2, further including 

a user control (230) that facilitates a change of orientation (650) of the 
representation of the three dimensional object, thereby effecting a change of the perspective 
25 renderings of each input video image (101). 

4. The video display system (1 00) of claim 3, wherein 

the change of orientation (650) corresponds to a change of selection of input 
video images from the source of multiple input video images (101). 
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5. The video display system (100) of claim 3, wherein 

the representation of the three dimensional object corresponds to a 
representation of a book (850) comprising multiple pages, 

the change of orientation (650) of the representation corresponds to a turning 
of a page of the multiple pages. 

6. The video display system (100) of claim 3, wherein 

the user control (230) facilitates a change of orientation (750, 760) via a 
plurality of orientation controls, 

each orientation control (750, 760) corresponding to a different set of input 
video images from the source of multiple video images, and 

each change of orientation (750, 760) corresponding to a change of selection 
of input video images from the corresponding set of input video images. 

7. The video display system (100) of claim 1, wherein 

the horizontal scaler (130) corresponds to a horizontal scan rate converter, and 
the vertical scaler (120) corresponds to a vertical scan rate converter. 

8. A method of rendering a plurality of video images on a display surface, 
comprising: 

associating (310) each video image of the plurality of video images with a 
surface of a representation of a three dimensional object, and 

for each video image: 

determining a rotation scale (cos(A)) corresponding to an angle (A) of 
the corresponding surface relative to the display surface, 

scaling the video image (330, 335) based on the rotation scale to 
produce an array of scaled image values, 

determining a perception scale (350, 355) corresponding to a depth of 
each scaled image value of the array of scaled image values relative to the display surface, 
and 

scaling each scaled image value (360, 365) based on the perception 
scale to produce an array of pixel values corresponding to the video image. 



WO 01/52528 PCT/EP00/12585 

16 

9. The method of claim 8, wherein 

the scaling of the video image (330, 335) corresponds to a select one of a 
vertical sample rate conversion (335) and a horizontal sample rate conversion (330) of the 
video image, and 

the scaling of each scaled image values (360, 365) corresponds to an opposite 
one of the vertical and horizontal sample rate conversion from the select one. 

10. A program that is configured to be stored in a memory for execution by a 
processing device, the program being configured to: 

enable an association of a video image (310) to a surface of a representation of 

a three dimensional object, 

enable a determination of a rotation scale corresponding to an angle of the 

surface relative to a display surface, 

enable a scaling of the video image (330, 335) based on the rotation scale to 

» 

produce an array of scaled image values, 

enable a determination of a perception scale (350, 355) corresponding to a 
depth of each scaled image value of the array of scaled image values relative to the display 
surface, and 

enable a scaling of the scaled image values (360, 365) based on the perception 
scale to produce an array of pixel values corresponding to the video image. 

1 1 . The program of claim 1 0, further including 

enabling a user control that facilitates a change of orientation (650) of the 
representation of the three dimensional object, thereby effecting a change of at least one of 
the rotation scale and the perception scale. 
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